Audible and visual operational modes for a head-mounted display device

ABSTRACT

The invention is directed towards wearable devices and operating wearable devices in a visual mode when a display device of the wearable device is within a line-of-sight (LOS) of a user and operating the wearable device in an audible mode when the wearable device is outside the LOS of the user. The position of the display device, relative to the user&#39;s LOS, is automatically determined. The operational mode of the wearable device is automatically transitioned when a transition of position of the display device is detected. The wearable device may be a head-mounted display (HMD) device. A visual mode provides visual-based presentations of UIs, content, information, and data, via the display device. In contrast to a visual mode, an audible mode provides audio-based presentations of UIs, content, information, and data, via one or more audible speakers included in the wearable device.

CROSS REFERENCE TO RELATED APPLICATIONS

The present application is a continuation of and claims priority fromapplication Ser. No. 15/697,281 filed Sep. 6, 2017, which is assigned orunder obligation of assignment to the same entity as this application,the entire contents of the application being herein incorporated byreference.

BACKGROUND

Wearable devices, such as head-mounted display (HMD) devices, haveenabled users to conveniently transport and access computingcapabilities, while located in (and during transit to) remote and/ornon-traditional computing environments. That is, users seeking access tocomputing capabilities no longer require desktop-based computing devicesand Ethernet ports. Rather, users may now conveniently “wear” acomputing device (i.e. a wearable device) to a remote location. Thewearable device is enabled to provide various computing capabilitiesthat may exceed the capabilities of many desktop-based computingdevices. Often, such wearable devices provide access to computingcapabilities via user-interfaces (UIs) displayed by a display deviceembedded within the wearable device.

However, in some circumstances, it may be unsafe or otherwiseundesirable to have the user diverting their glance (or attention) tothe display device or otherwise positioning the display device withinthe user's view. For instance, a display of a HMD device may restrictthe user's view of, or otherwise divert the user's attention away from,their environment or immediate surroundings. For example, withinindustrial and other settings, there may exist particular scenarioswhere limiting the user's view or attention to a display posessignificant safety risks to the user, as well as others. Thus, in suchscenarios, the user may remove the display from their view, or otherwisedivert their glance away from the general direction of the display.However, even when the display is not within their view, it is stilldesirable for enabling users to access to at least a portion of thecomputing capabilities provided by the wearable device. It is for theseand other concerns that the following disclosure is provided.

SUMMARY OF THE INVENTION

This summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This summary is not intended to identify key or essentialfeatures of the claimed subject matter, nor is it intended to be used asan aid in determining the scope of the claimed subject matter.

At a high level, embodiments of the present invention are generallydirected to operating wearable devices in a visual mode when a displaydevice of the wearable device is within a line-of-sight (LOS) of a userand operating the wearable device in an audible mode when the wearabledevice is outside the LOS of the user. The various embodiments mayautomatically determine when the display device is within and excludedfrom the LOS of the user. The embodiments may automatically transitionthe operational mode of the wearable device when a transition ofposition of the display device is detected. The wearable device may be ahead-mounted display (HMD) device. Although other embodiments are not solimited, and may be directed towards other computing devices such asother wearable devices or mobile devices.

Briefly, a visual mode is an operational mode of a wearable device thatprovides visual-based presentations of UIs, content, information, data,and the like, via the display device included in the wearable device.Such visual-based presentations include various visual elements, visualindications, and/or visual content that enable the user to receiveinformation, control the wearable device, and access capabilities of thewearable device through interactions with the visual-based presentationsof one or more UIs.

In contrast to a visual mode, an audible mode is an operational mode ofa wearable device that provides audio-based presentations of UIs,content, information, data, and the like, via one or more audiblespeakers included in the wearable device. Such audio-based presentationsinclude spoken-word, audible elements, audible indications, and/oraudible content that enable the user to receive information, control thewearable device, and access capabilities of the wearable device throughinteractions with the audio-based presentations of UIs. Furthermore,interaction with visual-based and/or audio-based presentations of UIsmay be at least partially speech-driven. That is, the user may controlthe wearable device (in either audible and/or visual mode) herein andaccess various capabilities of the wearable device via verbally speakingvoice-activated commands that are detected by one or more otherelectroacoustic transducers (e.g. a microphone) included in the wearabledevice.

BRIEF DESCRIPTION OF THE DRAWINGS

The features of the invention noted above are explained in more detailwith reference to the embodiments illustrated in the attached drawingfigures, in which like reference numerals denote like elements, in whichFIGS. 1-6 illustrate an embodiment of the present invention and inwhich:

FIG. 1 provides a schematic diagram showing an exemplary operatingenvironment for operating a head-mounted display device, in accordancewith some implementations of the present disclosure;

FIG. 2 shows an exemplary embodiment of a head-mounted display device,in accordance with some implementations of the present disclosure;

FIG. 3A shows an exemplary embodiment of a head-mounted display device,where the position of the display device is within the line-of-sight ofthe user;

FIG. 3B shows the head-mounted display device of FIG. 3A, where theposition of the display device is outside the line-of-sight of the user;

FIG. 4A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of a head-mounted display device, inaccordance with some implementations of the present disclosure;

FIG. 4B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of a head-mounted display device, inaccordance with some implementations of the present disclosure;

FIG. 5A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of a head-mounted display device, inaccordance with some implementations of the present disclosure;

FIG. 5B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of an augmented-reality enabledhead-mounted display device, in accordance with some implementations ofthe present disclosure;

FIG. 6A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of a head-mounted display device, inaccordance with some implementations of the present disclosure;

FIG. 6B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of a head-mounted display device, inaccordance with some implementations of the present disclosure;

FIG. 7A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of a head-mounted display device, inaccordance with some implementations of the present disclosure;

FIG. 7B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of a head-mounted display device, inaccordance with some implementations of the present disclosure;

FIG. 8A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of an augmented-reality enabled head-mounteddisplay device, in accordance with some implementations of the presentdisclosure;

FIG. 8B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of an augmented-reality enabledhead-mounted display device, in accordance with some implementations ofthe present disclosure;

FIG. 8C provides a schematic diagram showing additional operations of anexemplary embodiment of an audible mode of an augmented-reality enabledhead-mounted display device, in accordance with some implementations ofthe present disclosure;

FIGS. 9A-9B provide illustrative process flows depicting a method foroperating a wearable device, in accordance with some implementations ofthe present disclosure;

FIG. 10 provides an illustrative process flow depicting another methodfor operating a wearable device, in accordance with some implementationsof the present disclosure;

FIGS. 11A-11B provide illustrative process flows depicting still anothermethod for operating a wearable device, in accordance with someimplementations of the present disclosure;

FIG. 12 provides a block diagram of an exemplary wearable device inwhich some implementations of the present disclosure may be employed.

FIG. 13 provides a block diagram of an exemplary computing device inwhich some implementations of the present disclosure may be employed.

DETAILED DESCRIPTION

The various embodiments herein are directed towards methods and systemsfor operating mobile devices, such as but not limited to wearabledevices in a visual mode when a display device of the wearable device iswithin the user's LOS and operating the wearable device in an audiblemode when the display device is excluded from the user's LOS. Moreparticularly, the various embodiments may automatically detect when thedisplay device is within the user's LOS and when the display is excludedfrom the user's LOS. Based upon such detections of the position of thedisplay device (relative to the user's LOS), or alternatively based upondetecting transitions of the position of the display, the wearabledevice may be operated in (or transitioned to) the correspondingoperational mode. In various embodiments, the user's LOS may beconstrued broadly to include anywhere within the eyesight (orfield-ofview) of the user. For instance, the display device may beconsidered to be within the user's LOS when the display device ispositioned within the user's periphery vision, or when the displaydevice is above or below the user's pupils, but the user can stillvisually see the display device. In at least one embodiment, the displaydevice is within the user's LOS when the user may track and/or focus onthe display device via the manual rotation of their eyes within theirorbital sockets.

Many of the capabilities provided by conventional mobile technologiesare accessed, at least partially, via the user viewing and interactingwith user-interfaces (UIs) provided by one or more display devices. Forinstance, mobile devices such as conventional wearable devices provideinformation and enable users to control and access computingcapabilities via UIs viewable on a display device integrated with thewearable device. That is, some UIs that enable the user to control themobile device, to view documents, to receive notifications, to provideuser selections, or otherwise access and/or control many of thecapabilities associated with the wearable device require an activevisual observation, of a display device, by the user.

In addition to the user's attentive eyesight, such UIs often requiremanual and/or physical manipulation by the user, i.e. the use of theuser's hands and/or fingertips is required. For example, a user may viewa touch-sensitive display device of wearable device and perform manualgestures via a stylus, their hands, and/or their fingertips to interactwith a UI.

However, it may not always be convenient, or even safe, for the user toorient their line-of-sight (LOS) to include the display device, orotherwise position the display device within their LOS. Additionally,even if a user may divert their LOS or attention towards a displaydevice, it may still be inconvenient or unsafe for the user to use theirhands and/or fingertips to interact with the UI.

For example, within industrial and other settings, there may existparticular scenarios where restricting or limiting the user's LOS orattention to a display device poses significant safety risks to theuser, as well as others. In such scenarios, the user may remove thedisplay device from their LOS, or otherwise divert their LOS away fromthe general direction of the display device. However, even when thedisplay device is not within the user's LOS, or it is inconvenient orunsafe for the user to user their hands to interact with the displaydevice or another selection input-device, it is still desirable for theuser to control the wearable device and access computing capabilitiesprovide by the wearable device.

To address such concerns and limitations, the various embodiments hereinare directed towards methods and systems for operating wearable devicesin a visual mode when a display device of the wearable device is withinthe user's LOS and operating the wearable device in an audible mode whenthe display device is excluded from the user's LOS. Briefly, a visualmode is an operational mode of a wearable device that providesvisual-based presentations of UIs, content, information, data, and thelike, via the display device included in the wearable device. Suchvisual-based presentations include various visual elements, visualindications, and/or visual content that enable the user to receiveinformation, control the wearable device, and access capabilities of thewearable device through interactions with the visual-based presentationsof one or more UIs.

In contrast to a visual mode, an audible mode is an operational mode ofa wearable device that provides audio-based presentations of UIs,content, information, data, and the like, via one or more audiblespeakers included in the wearable device. Such audio-based presentationsinclude spoken-word, audible elements, audible indications, and/oraudible content that enable the user to receive information, control thewearable device, and access capabilities of the wearable device throughinteractions with the audio-based presentations of UIs. Furthermore,interaction with visual-based and/or audio-based presentations of UIsmay be at least partially speech-driven. That is, the user may controlthe wearable device (in either audible and/or visual mode) herein andaccess various capabilities of the wearable device via verbally speakingvoice-activated commands that are detected by one or more otherelectroacoustic transducers (e.g. a microphone) included in the wearabledevice.

Although many of the embodiments discussed herein are directed towardsoperating (and transitioning between) visual and audible modes of ahead-mounted display (HMD) device, it should be understood that not allembodiments are so limited. That is, it should be understood that thevarious embodiments discussed herein, may be applied to other computingdevices, including but not limited to other wearable devices (e.g.smartwatches) and mobile devices (e.g. smartphones and tablets).

FIG. 1 provides a schematic diagram showing an exemplary operatingenvironment 100 for operating a head-mounted display device inaccordance with some implementations of the present disclosure.Environment 100 includes one or more wearable devices, such as but notlimited to head-mounted display (HMD) device 120 and one or more usercomputing devices. Such user computing devices include, but are nototherwise limited to smartphone 102, desktop 104, tablet 106, and laptop108. Various embodiments of HMD device 120 are discussed in conjunctionwith at least FIGS. 2A, 2B, 3, and 12. However, briefly here, HMD device220 is a wearable computing device that provides computing andcommunication capabilities to the wearer. In the non-limiting body shownin FIG. 1, a wearable device (e.g. HMD device 120) may be worn about thehead of the user. Other embodiments are not so limited. Variousembodiments of user computing devices, such as computing devices 102-108are discussed in conjunction with FIG. 13.

Environment 100 additionally includes a communication network, such asbut not limited to communication network 110, which communicativelycouples each of user computing devices 102-108 and HMD device 120.Communication network 110 may be any communication network, includingvirtually any wired and/or wireless communication technologies, wiredand/or wireless communication protocols, and the like. It should beunderstood that communication network 110 may be virtually any networkthat communicatively couples at least one of user computing devices102-108 with a wearable device, such as but not limited to HMD device120.

FIG. 2 shows an exemplary embodiment of a head-mounted display device220, in accordance with some implementations of the present disclosure.HMD device 220 is a wearable device and may include similar features tothat of wearable device 1200 of FIG. 12. HMD device 220 may be similarto HMD device 120 of FIG. 1. HMD device 220 includes a frame member 222.Frame member 222 may be a frame structure. As shown in FIG. 2, framemember 222 is configured and arranged for wearing by a user. Forinstance, frame member 222 may be worn about the user's head. HMD device224 may additionally include one or more stabilizing members 224 (orstabilizing structures) that stabilize the frame member 222 about theuser's head.

HMD device 220 may include one or more rotating members, such as but notlimited to first rotating member 226 and second rotating member 228. Asdiscussed in conjunction with FIGS. 3A-3B, at least one rotating members226 or 228 is rotatably coupled to frame member 222, i.e. at least oneof rotating members 226 or 228 is coupled to frame member and configuredand arranged for rotating relative to frame member 222. In at least oneembodiment, first rotating member 226 may be a boom arm that is coupledto a display module 230. Display module 230 houses a display device (notshown in FIG. 2) that is directed towards the eyes of the users. Asshown in FIG. 2, the display device is within the user's line-of-sight(LOS). As discussed in conjunction with FIGS. 3A-3B, the user mayre-position the display device, via a rotation of one or more ofrotating members, such the display device is excluded from the user'sLOS. Note that in the view of HMD device 220 shown in FIG. 2, thedisplay device is occluded. However, various embodiments of the user'sview of the display device (when the display device is within the user'sLOS) are shown in FIGS. 4A, 5A, 6A, 7A, and 8A.

HMD device 220 includes various electroacoustic transducers (e.g.microphones and audio speakers). One such electro acoustic transducer232 is located near a distal end of rotating member 226. Electroacoustictransducer 232 may be a primary microphone. In various embodiments, HMDdevice 220 includes one or other electroacoustic transducers, includingbut not limited to one or more auxiliary microphones 234 and one or moreaudio speakers, such as but not limited to audio speaker 236.

HMD device 220 may include an optical module 240 that houses one or morephoton-detectors (e.g. camera devices), such as photon-detector 242and/or one or more photon-emitters (e.g. scanning lasers, scanning lightemitting diodes (LED), and the like), such as photon-emitter 244.Optical module 240 may be configured and arranged to rotate relative toframe member 222, such that the field-of-view (FOV) of thephoton-detector 242 may be rotationally varied. In at least somerotational orientations of optical module 240, the FOV ofphoton-detector 242 is at least similar to the FOV of the user.

FIG. 3A shows an exemplary embodiment of a head-mounted display device320, where the position of the display device is within theline-of-sight of the user. FIG. 3B shows the head-mounted display device320 of FIG. 3A, where the position of the display device is outside theline-of-sight of the user. HMD device 320 may be similar to HMD device220 of FIG. 2 and/or HMD device 120 of FIG. 1, and thus includes adisplay device. In the various embodiments, when the display device ispositioned such that as shown in FIG. 3A, HMD device 320 is operated ina first operational mode (i.e. a visual mode). When the display deviceis positioned outside of the user's line-of-sight (LOS) (such as thatshown in FIG. 3B), HMD device 320 is operated in a second operationalmode (i.e. an audible mode.)

HMD device 320 includes frame member 322, first rotating member 226, andsecond rotating member 328. HMD device 320 includes primary microphone332 and multiple auxiliary microphones 334, as well as one or more audiospeakers 336. Furthermore, HMD device 320 includes one or more cameras342 and one or more photon-emitters 344. Camera 342 may be aphoton-detector. Display module 330 houses the display device that isdirected towards the eyes of the users and is occluded in FIGS. 3A-3B.Various embodiments of the user's view of the display device (when thedisplay device is within the user's LOS) are shown in FIGS. 4A, 5A, 6A,7A, and 8A.

As noted above, FIG. 3A shows that display module 330 may be positionedsuch that the display device is within the line-of-sight (LOS) of theuser. A comparison of FIG. 3B with FIG. 3A shows that at least one offirst rotating member 326 and/or second rotating member 328 can berotated, relative to frame member 322, such that the display device isoutside of (or excluded from) the LOS of the user. More particularly,second rotating member 328 is rotatably coupled to frame member 322 viaa first rotational joint 354 and first rotating member 326 is rotatablycoupled to second rotating member 328 via a second rotational joint 352.

Thus, by varying at least one or a first rotational orientation betweenthe frame member 322 and the second rotating member 328 and/or a secondrotational orientation between the second rotating member 328 and thefirst rotating member 226, a user may rotate the position of the displayaxis about an axis relative to their head.

More particularly, by rotating the position of the display (about theaxis relative to their head), the user may selectively position thedisplay module 330 such that the display device is within their LOS.Similarly, the user may selectively position the display module 330 suchthat the display device is outside of (or excluded from) from their LOSby varying the first rotational orientation between the frame member 322and the second rotating member 328 and/or the second rotationalorientation between the second rotating member 328 and the firstrotating member 226. Note that by varying the first rotationalorientation, a first angle between the frame member 322 and the secondrotating member 328 is varied. Similarly, varying the second rotationalorientation generates a variance in a second angle between the secondrotating member 328 and the first rotating member 326. Further note thatby varying at least one of the first or the second angle generates avariance in an angle between the display device and the frame member322.

Whether the display device is within or outside the LOS of the user maybe determined based on at least one of a first angle (i.e. the anglebetween frame member 322 and second rotating member 328), the secondangle (i.e. the angle between second rotating member 328 and firstrotating member 326), and/or the lengths of first/second rotatingmembers 326/328. In various embodiments, one or more position-detectingsensors and/or switched are included in first rotational joint 354 toautomatically detect and/or determine the first angle. Similarly, one ormore position-detecting sensors and/or switches may be included insecond rotational joint to automatically determine the second angle.Such sensors and/or switches may include, but are not otherwise limitedto Hall Effect sensors and/or Hall Effect switches. Other such sensorsand/or switches may also include, but are not limited to, opticalsensors that detect optical encodings, mechanical switches, capacitivesensors, conductive switches, magnetic switches, and the like. That is,any position-detecting sensor and/or switch may be employed to determinewhether the display device is within the user's LOS. More specifically,signals generated by such sensors and/or switches may be employed todetect the position of display device relative to the user's LOS.According whether the display device is within or excluded from theuser's LOS may be automatically determined based on one or more signalsgenerated by sensors and/or switches that are employed to detect arelative rotation and/or an angle between multiple members of a wearabledevice, such as but not limited to HMD device 320.

HMD device 320, as shown in FIGS. 3A-3B, is a non-limiting embodiment,and transitioning and/or repositioning a display device within and outof the user's LOS may be accomplished via configurations other thanrelative rotations and/or rotational orientations of frame member 322,first rotating member 326, and second rotating member 328. Note thatfirst and second rotating members 326/328 may comprise a rotatable boomarm for supporting the display module 330. Thus, the boom arm may bearticulated within and out of the user's LOS.

Furthermore, other methods for determining when the display device iswithin and outside of the user's LOS may be employed for otherconfigurations other than relative rotations between members. Forinstance, relative translations between members supporting the displaydevice may be sensed and/or detected. When the display device istransitioned from within the user's LOS to outside the user's LOS, theoperational mode of HMD device 320 is transitioned from a visual mode toan audible mode. Similarly, when the display device is transitioned frooutside the user's LOS to within the user's LOS, the operational mode ofHMD device 320 is transitioned from the audible mode to the visual mode.

In at least one embodiment, the user may select the transition of theoperational mode, via verbally speaking voice-activated commands, suchas but not limited to “visual mode,” “audible mode,” and the like. Suchvoice activated commands may be detected via electroacoustictransducers, such as but not limited primary microphone 332 and/orauxiliary microphones 334. In some embodiments, a first subset of theset available microphones may be operated when HMD device 320 isoperated in the visual mode. A second subset of the set availablemicrophones may be operated when HMD device 320 is operated in theaudible mode. In some embodiments, the intersection of the two subsetsof the set of available microphones is the empty set. In otherembodiments, the intersection of the two subsets of availablemicrophones includes one or more microphones.

For example, during operation in the visual mode, in some embodiments,only the primary microphone 332 is operated and/or activated. Becauserotation of the boom arm (first/second rotating members 326/328) maydisplace primary microphone 332 away from the user's mouth, at least aportion of the auxiliary microphones 334 may be operated and/oractivated during audible mode. In some embodiments, primary microphone332 may be continued to be operated and/or activated during audiblemode. In other embodiments, primary microphone may not be operatedduring audible mode.

As noted above and in general, a visual mode is an operational mode of awearable device that provides visual-based presentations of UIs,content, information, data, and the like, via the display deviceincluded in the wearable device. Such visual-based presentations includevarious visual elements, visual indications, and/or visual content thatenable the user to receive information, control the wearable device, andaccess capabilities of the wearable device through interactions with thevisual-based presentations of one or more UIs.

In contrast to a visual mode, an audible mode is an operational mode ofa wearable device that provides audio-based presentations of UIs,content, information, data, and the like, via one or more audiblespeakers included in the wearable device. Such audio-based presentationsinclude spoken-word, audible elements, audible indications, and/oraudible content that enable the user to receive information, control thewearable device, and access capabilities of the wearable device throughinteractions with the audio-based presentations of UIs. Furthermore,interaction with visual-based and/or audio-based presentations of UIsmay be at least partially speech-driven. That is, the user may controlthe wearable device (in either audible and/or visual mode) herein andaccess various capabilities of the wearable device via verbally speakingvoice-activated commands that are detected by one or more otherelectroacoustic transducers (e.g. a microphone) included in the wearabledevice.

FIG. 4A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of a head-mounted display device, inaccordance with some implementations of the present disclosure. The HMDdevice may be similar to HMD device 320 of FIGS. 3A-3B, HMD device 220of FIG. 2, and/or HMD device 120 of FIG. 1. Hashed boundary 400schematically demarcates the user's LOS. Similar to the positioning ofthe display module 330 of HMD device 320 of FIG. 3A, display module 430(and the display device 460) of FIG. 4A are within the user's LOS. Firstrotating member 426 supports the display module 430. The primarymicrophone 436 is located near the distal end of first rotating member426.

In FIG. 4A, the user of the HMD device is being provided, via displaydevice 460, visual presentations of content, such as but not limited toa video presentation 470 of maintaining a jetliner engine. Visualpresentations of other content may be superimposed, combined, blended,layers, and/or composited with video presentation 470. For instance,visual elements such as text box 473 and directional arrow 474 aresuperimposed over video presentation 470 displayed on display device460. Each of the superimposed visual elements (i.e. text box 472 anddirectional arrow 474) provide a visual indication of a notification tothe user, i.e. a notification that notifies the user which screws totighten and a direction which to tighten then. A user of a remotecomputing device, such as but not limited to any of user computingdevices 102-108 of FIG. 1, may be providing the video presentation 470and/or any of the telestrations, such as but not limited to visualelements text box 472 and directional arrow 474.

FIG. 4B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of a head-mounted display device 420, inaccordance with some implementations of the present disclosure. HMDdevice 420 may be similar to HMD device 320 of FIGS. 3A-3B, HMD device220 of FIG. 2, and/or HMD device 120 of FIG. 1. Hashed boundary 400schematically demarcates the user's LOS. Similar to the positioning ofthe display device of HMD device 320 of FIG. 3B, the display device ofHMD device 420 is outside of the user's LOS.

In FIG. 4B, the user of HMD device 420 is being provided, via an audiblespeaker of HMD device 420, audible presentations of at least a portionof the content provided to the user associated with FIG. 4A. Morespecifically, as shown via the comment bubble, an audible voice providesan audible indication of at least a portion of the notification shown inFIG. 4A. The voice may be a computer-generated voice, i.e. the verbalnotification may be computer generated speech. The generation of thespeech may be based on the notification to provide the user.

For instance, HMD device 420 may receive an instruction or a request toprovide content, such as but not limited to a notification, to the userof the HMD device 420. The notification may include a visual element,such as but not limited to text box 472 and/or directional arrow 474 ofFIG. 4A. In various embodiments, the instruction may be received from aremote user of a remote computing device, such as one or user computingdevices 102-108 of FIG. 1. When HMD device 420 is operated in an audiblemode, an audible indication of the visual element may be determined,either by HMD device 420 or another computing device. FIG. 4Bdemonstrates the audible indication of the visual element, being provedto the user via audible words.

In various embodiments, the instruction may include a feature of thecontent. Some features of content may be associated with a visual-onlycondition. For instance, notifications that are not easily provided viaaudible means or notifications and/or warnings of critical importancemay be associated with a visual-only condition. Some visual-onlyconditions associated with features of content may include, but are notlimited to, the display of one or more of geographical maps,instructional videos, graphical symbols and/or icons, a virtual object,an avatar of another user, or the like. HMD device 420 may determine thefeature included in the received instruction. If the HMD device is beingoperated in the audible mode and the determined feature is associatedwith a visual-only condition, an audible indication (indicating thevisual-only condition) may be provided to the user, via an audiblespeaker of the HMD device.

For instance, computer-generated speech may provide a warning or arequest for the user to re-position the display device within their LOS.That is, a voice that is automatically generated by the HMD device mayinstruct the user to “Please lower the display unit,” or some othermessage that includes a similar sentiment. In response to detectingand/or determining that the user has repositioned the display devicewithin their LOS, the HMD device may automatically be transitioned tothe visual mode of operation. The content may then be visually providedto the user via the display device. In some embodiments, the feature ofthe content may be associated with a visual-optional condition.Accordingly, when the HMD device is being operated in the audible mode,the audible indications of the content may be determined and provided tothe user, via the audible speakers of the HMD device.

FIG. 5A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of a head-mounted display device, inaccordance with some implementations of the present disclosure. Similarto FIG. 4A, hashed boundary 400 schematically demarcates the user's LOS.In FIG. 5A, a photon-detector of the HMD device may generate image dataof the FOV of the photon-detector. The FOV of the photon-detector may besimilar to the LOS or the FOV of the user. As shown in FIG. 5A, theimage data be displayed by the display device 560.

In addition to being displayed via displayed device 560, the image datamay be provided to a remote user of a remote computing device, such asuser computing devices 102-108 of FIG. 1. The remote computing devicemay provide visual elements (e.g. telestrations) of a notification or awarning. An instruction to provide the notification to the user may bereceived, from the remote computing device, at the HMD device. Whenbeing operated in the visual mode, the visual elements and/or visualindications of the notification may be provided to the user bysuperimposing and/or compositing the visual indications over the imagedata displayed on display device 560. For instance, display device 560is shown displaying text box 572 and indication arrow 574.

FIG. 5B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of a head-mounted display device 520, inaccordance with some implementations of the present disclosure. Similarto HMD device 420 of FIG. 4B, HMD device 520 is shown providing anaudible indication of the visual elements (text box 572 and indicationarrow 574) of FIG. 5A.

FIG. 6A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of a head-mounted display device, inaccordance with some implementations of the present disclosure. Moreparticularly, display device 660 is shown superimposing visualindications for multiple user-options over visual content and/or imagedata. In FIG. 6A, an icon associated with “Document A” (first icon 672)and an icon associated with “Document B” (second icon 674) are visualindications of user-options. That is, a user may select either “DocumentA” (a first user-option) or “Document B” (a second user-option) fordisplay on display device 660. The user may select from the user-optionsby verbalizing their choice. The HMD device may receive such audibleindications of the user selection via one or more microphones includedin the HMD device.

FIG. 6B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of a head-mounted display device 620, inaccordance with some implementations of the present disclosure. Similarto HMD device 420 of FIG. 4B and/or HMD device 520 of FIG. 5B, HMDdevice 620 is shown providing an audible indication of a firstuser-option (Document A) and an audible indication of a seconduser-option (Document B). In at least one embodiment, when operating inthe audio mode, the user may indicate their selection of user-optionsvia selection components included in HMD device 620, such as but notlimited to selection buttons 622/624/626. Upon select of one of DocumentA or Document B, further selected portions of text, information, or dataincluded in the selected document may be narrated to the user byemploying text-to-speech services.

FIG. 7A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of a head-mounted display device, inaccordance with some implementations of the present disclosure. Displaydevice 760 is providing a visual indication 772 of a warning. Forinstance, an instruction may be received, from another device that isactively monitoring the temperature of the jetliner engine display viadisplay device 760.

FIG. 7B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of a head-mounted display device 720, inaccordance with some implementations of the present disclosure. Similarto HMD device 420 of FIG. 4B, HMD device 520 of FIG. 5B, and/or HMDdevice 620 of FIG. 6B, HMD device 720 is shown providing an audibleindication of the warning visually indicated in display device 760 ofFIG. 7A.

In at least some embodiments, a criticality or importance may bedetermined by HMD device 720. The computer-generated speech providingthe audible indication of the warning may be selectively audiblyemphasized to reflect the determined criticality and/or importance. Inat least some embodiments, a volume and/or a frequency of repeating theaudible indication may be based on the criticality and/or importance.

FIG. 8A provides a schematic diagram showing operations of an exemplaryembodiment of a visual mode of an augmented-reality enabled head-mounteddisplay device, in accordance with some implementations of the presentdisclosure. That is, any of the various HMD devices discussed herein maybe augmented-reality (AR) and/or mixed-reality (MR) enabled devices. Assuch, display device is at least partially optically transparent and theuser may view their environment through display device 860. Furthermore,display device 860 may superimpose visual elements and/or visualindications (such as but not limited to text box 872) on the portion ofthe user's environment viewed through display device 860.

The HMD device may include a photon-detector 842 and a photon-emitter844 (each of which are occluded in the view of FIG. 8A). As discussed inconjunction with at least FIG. 5A, image data captured and/or generatedby photon-detector 842 of photon-detector's FOV may be provided to aremote computing device.

FIG. 8B provides a schematic diagram showing operations of an exemplaryembodiment of an audible mode of an augmented-reality enabledhead-mounted display device, in accordance with some implementations ofthe present disclosure. Photon-emitter 844 may be employed to providelaser-based and/or LED-based telestrations on surfaces of the user'senvironment. For instance, in audible mode, when the notifications,warnings, and the like are not provided via display device 860,photon-emitter 844 may be employed to project such visual elements ontosurfaces of the user's environment. For instance, as shown in FIG. 8B,photon emitter is employed to project a visual indication 882 of textbox 872 of FIG. 8A on the corresponding surfaces of the user'senvironment.

Photon-emitter 844 is additionally employed to project (onto surfaces ofthe user's environment) a visual indication (i.e. bounding box 884) ofthe boundary of the FOV of photon-detector 842. The projection ofbounding box 884 provides the user a visual indication of the image datagenerated and/or captured via photon-detector 842. For instance, it maybe beneficial for the user of the HMD device to simultaneously viewimage data they are transmitting to a remote user. When in a visualmode, the user may view such image data via display device 860 (asdiscussed in conjunction with at least FIG. 5A). Projected bounding box884 informs the user of the FOV of the photon-detector that is employedto capture image data for the viewing of such a remote user.

In various embodiments, a remote user may initiate the change ortransition in the operational mode of the HMD device. That is, a remotecomputing device may process a change and/or a transition in theoperational mode of the HMD device, in response to a command and/orinstruction initiated by the remote user. In one such embodiment, theremote user of one of remote computing devices 102-108 of FIG. 1 maydisable the visual mode of the HMD device and enable the audible mode.For example, an administrative user can employ desktop 104 to provide acommand and/or instruction to the HMD device that transitions the HMDdevice from the visual mode to the audible mode (or vice-versa). Atleast one of an audible and/or a visual notification may be provided tothe user of the HMD device to provide an indication to the user that theoperational mode of the HMD device is being transitioned via a remoteuser and/or a remote computing device.

FIG. 8C provides a schematic diagram showing additional operations of anexemplary embodiment of an audible mode of an augmented-reality enabledhead-mounted display device, in accordance with some implementations ofthe present disclosure. In FIG. 8C, in addition to boundary box 884,photon-emitter is employed to project a visual indication of the center(e.g. bullseye 886) of the FOV of photon-detector 842. The visualindication of the center of the FOV of photon-detector may be virtuallyany indication, such as but not limited to a dot, a bullseye, a cursor,or some other indicator. The projection of a visual indication of thecenter of the FOV of photon-detector 842 provides the user furthervisual indication of the image data generated and/or captured viaphoton-detector 842.

Having described various aspects of the present disclosure, exemplarymethods are described below in for operating a wearable device.Referring to FIGS. 9A-9B in light of FIGS. 1-8C, FIGS. 9A-11B provideillustrative process flows depicting various methods for operating awearable device, in accordance with some implementations of the presentdisclosure. Each block of below method (900, 920, 1000, 1100, and 1120)and other methods described herein comprises a computing process thatmay be performed using any combination of hardware, firmware, and/orsoftware. For instance, various functions may be carried out by aprocessor executing instructions stored in memory. The methods may alsobe embodied as computer-usable instructions stored on computer storagemedia. The methods may be provided by a standalone application, aservice or hosted service (standalone or in combination with anotherhosted service), or a plug-in to another product, to name a few.

Process 900 of FIG. 9A begins at block 902. At block 902, a position ofa display device (or simply a display) of a wearable device isdetermined (or detected). The position may be a relative to theline-of-sight (LOS) of the user(i.e. a wearer of the wearable device).The wearable device may be a head-mounted display (HMD) device. At block904, a change (or transition) in operational modes of the wearabledevice is processed. Processing the change may be based on thedetermined and/or detected position of the display device relation tothe LOS of the user.

Process 920 of FIG. 9B begins at block 922. At block 922, an instructionto provide, by the display device, is received. The instruction may bereceived by the wearable device. At block 924, an audible indication ofthe visual element is determined. At block 926, the audible indicationof the visual element is provided by an audible speaker of the wearabledevice.

Process 1000 of FIG. 10 begins at block 1002. At block 1002, a firstorientation of a display device included in a wearable device isdetected (or determined). At block 1004, the wearable device is operatedin an operational model based on the detected orientation of the displaydevice. At block 1006, a transition on the orientation of the displaydevice is detected. At block 1008, the operation of the wearable deviceis transitioned (or processed) based on the transition in theorientation of the display device. For instance, the operational mode ofthe wearable device may be transitioned at block 1008.

Process 1100 of FIG. 11A begins at block 1102. At block 1102, an anglebetween a frame member of a wearable device and a rotating member of thewearable device is determined. At block 1104, the wearable device isoperated based on the determined angle.

Process 1120 of FIG. 11B begins at block 1122. At block 1122, afield-of-view (FOV) of a camera included in the wearable device isdetermined. At block 1124, a photon-emitter included in the wearabledevice in employed to project a visual indication of the DOV of thecamera. For instance, the photon-emitter may project a bounding box onsurfaces of the user's environment that correspond to the boundary ofthe FOV or a bullseye on a surface that corresponds to a center of theFOV.

Having described embodiments of the present invention, an exampleoperating environment in which embodiments of the present invention maybe implemented is described below in order to provide a general contextfor various aspects of the present invention.

FIG. 12 provides a block diagram of an exemplary wearable device 1200 inwhich some implementations of the present disclosure may be employed.Any of the various embodiments of wearable devices discussed herein,including but not limited to HMD device 120, 220, or 320 of FIGS, 1, 2,and 3A respectively, may include similar features, components, modules,operations, and the like as wearable device 1200. In this example,wearable device 1200 may be enabled for wireless two-way communicationdevice with voice and data communication capabilities. Such wearabledevices communicate with a wireless voice or data network 1250 using asuitable wireless communications protocol. Wireless voice communicationsare performed using either an analog or digital wireless communicationchannel. Data communications allow the wearable device 1200 tocommunicate with other computer systems via the Internet. Examples ofwearable devices that are able to incorporate the above describedsystems and methods include, for example, a data messaging device, atwo-way pager, a cellular telephone with data messaging capabilities, awireless Internet appliance or a data communication device that may ormay not include telephony capabilities.

The illustrated wearable device 1200 is an examplary wearable devicethat includes two-way wireless communications functions. Such wearabledevices incorporate communication subsystem elements such as a wirelesstransmitter 1210, a wireless receiver 1212, and associated componentssuch as one or more antenna elements 1214 and 1216. A digital signalprocessor (DSP) 1208 performs processing to extract data from receivedwireless signals and to generate signals to be transmitted. Theparticular design of the communication subsystem is dependent upon thecommunication network and associated wireless communications protocolswith which the device is intended to operate.

The wearable device 1200 includes a microprocessor 1202 that controlsthe overall operation of the wearable device 1200. The microprocessor1202 interacts with the above described communications subsystemelements and also interacts with other device subsystems such as flashmemory 1206, random access memory (RAM) 1204, auxiliary input/output(I/O) device 1238, data port 1228, display 1234, keyboard 1236, speaker1232, microphone 1230, a short-range communications subsystem 1220, apower subsystem 1222, and any other device subsystems.

A battery 1224 is connected to a power subsystem 1222 to provide powerto the circuits of the wearable device 1200. The power subsystem 1222includes power distribution circuitry for providing power to thewearable device 1200 and also contains battery charging circuitry tomanage recharging the battery 1224. The power subsystem 1222 includes abattery monitoring circuit that is operable to provide a status of oneor more battery status indicators, such as remaining capacity,temperature, voltage, electrical current consumption, and the like, tovarious components of the wearable device 1200.

The data port 1228 is able to support data communications between thewearable device 1200 and other devices through various modes of datacommunications, such as high speed data transfers over an opticalcommunications circuits or over electrical data communications circuitssuch as a USB connection incorporated into the data port 1228 of someexamples. Data port 1228 is able to support communications with, forexample, an external computer or other device.

Data communication through data port 1228 enables a user to setpreferences through the external device or through a softwareapplication and extends the capabilities of the device by enablinginformation or software exchange through direct connections between thewearable device 1200 and external data sources rather than via awireless data communication network. In addition to data communication,the data port 1228 provides power to the power subsystem 1222 to chargethe battery 1224 or to supply power to the electronic circuits, such asmicroprocessor 1202, of the wearable device 1200.

Operating system software used by the microprocessor 1202 is stored inflash memory 1206. Further examples are able to use a battery backed-upRAM or other non-volatile storage data elements to store operatingsystems, other executable programs, or both. The operating systemsoftware, device application software, or parts thereof, are able to betemporarily loaded into volatile data storage such as RAM 1204. Datareceived via wireless communication signals or through wiredcommunications are also able to be stored to RAM 1204.

The microprocessor 1202, in addition to its operating system functions,is able to execute software applications on the wearable device 1200. Apredetermined set of applications that control basic device operations,including at least data and voice communication applications, is able tobe installed on the wearable device 1200 during manufacture. Examples ofapplications that are able to be loaded onto the device may be apersonal information manager (PIM) application having the ability toorganize and manage data items relating to the device user, such as, butnot limited to, e-mail, calendar events, voice mails, appointments, andtask items.

Further applications may also be loaded onto the wearable device 1200through, for example, the wireless network 1250, an auxiliary I/O device1238, Data port 1228, short-range communications subsystem 1220, or anycombination of these interfaces. Such applications are then able to beinstalled by a user in the RAM 1204 or a non-volatile store forexecution by the microprocessor 1202.

In a data communication mode, a received signal such as a text messageor web page download is processed by the communication subsystem,including wireless receiver 1212 and wireless transmitter 1210, andcommunicated data is provided to the microprocessor 1202, which is ableto further process the received data for output to the display 1234, oralternatively, to an auxiliary I/O device 1238 or the data port 1228. Auser of the wearable device 1200 may also compose data items, such ase-mail messages, using the keyboard 1236, which is able to include acomplete alphanumeric keyboard or a telephone-type keypad, inconjunction with the display 1234 and possibly an auxiliary I/O device1238. Such composed items are then able to be transmitted over acommunication network through the communication subsystem.

For voice communications, overall operation of the wearable device 1200is substantially similar, except that received signals are generallyprovided to a speaker 1232 and signals for transmission are generallyproduced by a microphone 1230. Alternative voice or audio I/Osubsystems, such as a voice message recording subsystem, may also beimplemented on the wearable device 1200. Although voice or audio signaloutput is generally accomplished primarily through the speaker 1232, thedisplay 1234 may also be used to provide an indication of the identityof a calling party, the duration of a voice call, or other voice callrelated information, for example.

Depending on conditions or statuses of the wearable device 1200, one ormore particular functions associated with a subsystem circuit may bedisabled, or an entire subsystem circuit may be disabled. For example,if the battery temperature is low, then voice functions may be disabled,but data communications, such as e-mail, may still be enabled over thecommunication subsystem.

A short-range communications subsystem 1220 provides for datacommunication between the wearable device 1200 and different systems ordevices, which need not necessarily be similar devices. For example, theshort-range communications subsystem 1220 includes an infrared deviceand associated circuits and components or a Radio Frequency basedcommunication module such as one supporting Bluetooth® communications,to provide for communication with similarly-enabled systems and devices,including the data file transfer communications described above.

A media reader 1260 connectable to an auxiliary I/O device 1238 toallow, for example, loading computer readable program code of a computerprogram product into the wearable device 1200 for storage into flashmemory 1206. One example of a media reader 1260 is an optical drive suchas a CD/DVD drive, which may be used to store data to and read data froma computer readable medium or storage product such as computer readablestorage media 1262. Examples of suitable computer readable storage mediainclude optical storage media such as a CD or DVD, magnetic media, orany other suitable data storage device. Media reader 1260 isalternatively able to be connected to the wearable device through thedata port 1228 or computer readable program code is alternatively ableto be provided to the wearable device 1200 through the wireless network1250.

FIG. 13 provides a block diagram of an exemplary computing device 1300in which some implementations of the present disclosure may be employed.Computing device 1300 is but one example of a suitable computingenvironment and is not intended to suggest any limitation as to thescope of use or functionality of the invention. Neither should thecomputing device 1300 be interpreted as having any dependency orrequirement relating to any one or combination of componentsillustrated. Any computing device discussed herein, such as but notlimited to user computing devices 102-108 of FIG. 1, or any of thewearable devices discussed herein, may include similar operations,features, components, modules, and the like, as included in computingdevice 1300.

The invention may be described in the general context of computer codeor machine-useable instructions, including computer-executableinstructions such as program modules, being executed by a computer orother machine, such as a personal data assistant or another handhelddevice. Generally, program modules including routines, programs,objects, components, data structures, etc. refer to code that performparticular tasks or implement particular abstract data types. Theinvention may be practiced in a variety of system configurations,including hand-held devices, consumer electronics, general-purposecomputers, more specialty computing devices, etc. The invention may alsobe practiced in distributed computing environments where tasks areperformed by remote-processing devices that are linked through acommunications network.

With reference to FIG. 13, computing device 1300 includes a bus 1310that directly or indirectly couples the following devices: memory 1312,one or more processors 1314, one or more presentation components 1316,input/output ports 1318, input/output components 1320, and anillustrative power supply 1322. Bus 1310 represents what may be one ormore busses (such as an address bus, data bus, or combination thereof).Although the various blocks of FIG. 13 are shown with lines for the sakeof clarity, in reality, delineating various components is not so clear,and metaphorically, the lines would more accurately be grey and fuzzy.For example, one may consider a presentation component such as a displaydevice to be an I/O component. Also, processors have memory. Werecognize that such is the nature of the art, and reiterate that thediagram of FIG. 13 is merely illustrative of an exemplary computingdevice that can be used in connection with one or more embodiments ofthe present invention. Distinction is not made between such categoriesas “workstation,” “server,” “laptop,” “hand-held device,” etc., as allare contemplated within the scope of FIG. 13 and reference to “computingdevice.”

Computing device 1300 typically includes a variety of computer-readablemedia. Computer-readable media can be any available media that can beaccessed by computing device 1300 and includes both volatile andnonvolatile media, removable and non-removable media. By way of example,and not limitation, computer-readable media may comprise computerstorage media and communication media.

Computer storage media include volatile and nonvolatile, removable andnon-removable media implemented in any method or technology for storageof information such as computer-readable instructions, data structures,program modules or other data. Computer storage media includes, but isnot limited to, RAM, ROM, EEPROM, flash memory or other memorytechnology, CD-ROM, digital versatile disks (DVD) or other optical diskstorage, magnetic cassettes, magnetic tape, magnetic disk storage orother magnetic storage devices, or any other medium which can be used tostore the desired information and which can be accessed by computingdevice 1300. Computer storage media excludes signals per se.

Communication media typically embodies computer-readable instructions,data structures, program modules or other data in a modulated datasignal such as a carrier wave or other transport mechanism and includesany information delivery media. The term “modulated data signal” means asignal that has one or more of its characteristics set or changed insuch a manner as to encode information in the signal. By way of example,and not limitation, communication media includes wired media such as awired network or direct-wired connection, and wireless media such asacoustic, RF, infrared and another wireless media. Combinations of anyof the above should also be included within the scope ofcomputer-readable media.

Memory 1312 includes computer storage media in the form of volatileand/or nonvolatile memory. The memory may be removable, non-removable,or a combination thereof. Exemplary hardware devices include solid-statememory, hard drives, optical-disc drives, etc. Computing device 1300includes one or more processors that read data from various entitiessuch as memory 1312 or I/O components 1320. Presentation component(s)1316 present data indications to a user or another device. Exemplarypresentation components include a display device, speaker, printingcomponent, vibrating component, etc.

I/O ports 1318 allow computing device 1300 to be logically coupled toother devices including I/O components 1320, some of which may be builtin. Illustrative components include a microphone, joystick, game pad,satellite dish, scanner, printer, wireless device, etc

Embodiments described in the paragraphs below may be combined with oneor more of the specifically described alternatives. In particular, anembodiment that is claimed may contain a reference, in the alternative,to more than one other embodiment. The embodiment that is claimed mayspecify a further limitation of the subject matter claimed.

Accordingly, in one embodiment described herein, includes a method foroperating a wearable device that includes a display device (or simply adisplay). The method includes automatically determining a position ofthe display relative to a line-of-sight (LOS) of a user that is wearingthe wearable device. When the position of the display is within the LOSof the user, the wearable device is operated in a first operational mode(e.g. a visual mode). When the position of the display is outside and/orexcluded from the LOS of the user, the wearable device is operated in asecond operational mode (e.g. and audible mode). In some non-limitingembodiments, the wearable device is a head-mounted display (HMD) device.The display may be configured and arranged such that the position of thedisplay relative to the LOS rotates about an axis of the user. Forinstance, the position of the display may rotate about a frontal axis ofthe user.

In some embodiments, the wearable device includes a first member and asecond member. Determining the position of the display may includedetermining a relative rotational orientation between a first member anda second member. The first and second members are configured andarranged such that s variance of the rotational orientation between thefirst member and the second member generates a variance between thefirst member and the display. Determining the position of the displaymay be based on receiving a signal generated by a sensor and/or switchincluded in the wearable device, such as but not limited to a Halleffect sensor and/or switch.

Operating the wearable device in the first operational mode may includeemploying the display to provide the user a visual indication of anotification. Operating the wearable device in the second operationalmode may include employing an electroacoustic transducer (e.g. an audiospeaker) included in the wearable device to provide the user an audibleindication of the notification. For instance, a information included inthe notification may be provided as a computer-generated (or a humangenerated) vocalization of the information (e.g. spoken word).

In some embodiments, operating the wearable device in the firstoperational mode includes operating a first electroacoustic transducer(e.g. a primary microphone) included in the wearable device. Operatingthe wearable device in the second operational mode includes operatingone or more other electroacoustic transducers (e.g. auxiliary and/oradditional microphones) included in the wearable device.

In various embodiments, the method further includes determining afeature of content to provide to the user. When the feature of thecontent is associated with a visual-only condition, an audio speakerincluded in the wearable device is employed to provide the user anaudible indication regarding the content is associated with avisual-only condition. For instance, the wearable device may provide avocalization of a request to reposition the display within their LOS sothat they may view the visual-only content, as it is provided via thedisplay. When the feature of the content is associated with avisual-optional condition, the audio speaker is employed to provide theuser an audible indication of the content.

In at least one embodiment, operating the wearable device in the firstoperational mode includes employing the display to provide the user avisual indication of a first user-option and a visual indication of asecond user-option. For instance, the display may show two separateicons, each corresponding to a separate document that the user mayselect to view via the display. Operating the wearable device in thesecond operational mode includes employing an audio speaker included inthe wearable device to provide the user an audible indication of thefirst user-option and an audible indication of the second user-option.For instance, a computer generated voice may ask the user which of thetwo documents to select, via vocalizing at least the an identifier foreach of the documents. In at least one embodiment, upon selection (via avoice command by the user), the computer-generated voice may read atleast a portion of the content of the selected document to the user.

In some embodiments, operating the wearable device in the firstoperational mode further includes employing a microphone of the wearabledevice to receive an audible indication of a user-selection (e.g aselection indicated by a voice-command by the user) of one of the firstuser-option or the second user-option. Operating the wearable device inthe second operational mode further includes employing a selectioncomponent (e.g. physical buttons, switches, or the like) included in thewearable device, to receive a non-audible indication of theuser-selection (e.g. a selection indicated by a physical gesture such asselecting a button) of one of the first user-option or the seconduser-option.

The wearable device may further include a camera and a photon-emitter.Operating the wearable device in the second operational mode includesemploying the photon- emitter to project a visual indication of afield-of-view (FOV) of the camera. For instance, the photon-emitter mayinclude a laser or a collimated light emitting diode (LED) to projectphoton beams to trace a boundary of the FOV on surfaces at the boundaryof the FOV of the camera. Or in other embodiments, the photon-emittermay project a dot, a bullseye, a cursor, or some other indicator on aphysical surface that is located at the center of the FOV.

In various embodiments, the method further includes receiving aninstruction to provide a visual element. An audible indication of thevisual element may be determined. The method further employs an audiospeaker of the wearable device to provide the audible indication of thevisual element.

Other embodiments include a non-transitory computer storage media thatstores instruction. When executed by a processor, the processor isenabled to perform a method or actions for operating a wearable devicethat includes a display and a frame structure, such as a frame member.The actions include detecting a first orientation of a display. Thefirst orientation of the display includes a first position of thedisplay relative to a frame structure. In response to detecting thefirst orientation of the display, the wearable device is operated in afirst operational mode. The actions further include detecting atransition from the first orientation of the display to a secondorientation of the display. The second orientation of the displayincludes a second position of the display relative to the framestructure. The second position is separate or different than the firstposition. In response to detecting the transition from the firstorientation of the display to the second orientation of the display,operating the wearable device is transitioned from the first operationalmode to a second operational mode.

In some embodiments, the first position of the display is such that thedisplay is within the line-of-sight (LOS) of a user that is wearing thewearable device and the second position of the display is such that thedisplay is outside of or excluded from the LOS of the user. In suchembodiments, the first operational mode may be a visual mode and thesecond operational mode is an audible mode. In other embodiments, thefirst position of the display is such that the display is excluded fromthe LOS of the user and the second position of the display is such thatthe display is within the LOS of the user. In these embodiments, thefirst operational mode may be an audible mode and the second operationalmode is a visual mode. In various embodiments, detecting the transitionfrom the first orientation of the display to the second orientation ofthe display includes detecting a rotation of a member of the wearabledevice relative to the frame structure of the wearable device.

In at least one embodiment, operating the wearable device in the firstoperational mode includes providing the user, by the display, a visualindication of content. Operating the wearable device in the secondoperational mode includes providing the user, via a speaker included inthe wearable device, an audible indication of the content. Transitionoperating the wearable device in the first operational mode to operatingthe wearable device in the second operational mode may includeactivating at least one microphone included in the wearable device. Themicrophone may be deactivated during operating the wearable device inthe first operational mode. For instance, an auxiliary microphone may beturned on when the operational mode is transitioned to audible mode. Theauxiliary microphone may be turned off in the visual mode of thewearable device. A primary microphone of the wearable device may beactivated during the visual mode. In some embodiments, the primarymicrophone is also activated during operation in the audible mode. Inother embodiments, the primary microphone is deactivated during thetransition from the visual mode to the audible mode.

Still another embodiment is directed towards a wearable device, such asbut not limited to a head-mounted display (HMD) device. The wearabledevice includes a frame member, a rotating member, a processor, and atleast one non-transitory computer storage media. The frame member isconfigured and arranged for wearing by a user. The rotating member isrotatable coupled to the frame member and configured and arranged forrotating relative to the frame member. The computer storage media storedcomputer-usable instructions that, when executed by the processor causethe processor to perform a method or actions for operating the wearabledevice. The actions include determining a relative angle between theframe member and the rotating member. When the relative angle is lessthan a predetermined threshold-angle, the wearable device is operated ina first operational mode. When the relative angle is greater than thepredetermined threshold-angle, the wearable device is operated in asecond operational mode. In some embodiments, the first operational modeis a visual mode and the second operational mode is an audible mode. Inother embodiments, the first operational mode is an audible mode and thesecond operational mode is a visual mode.

In various embodiments, the wearable device further includes apositioning-sensing sensor and/or switch, such as a Hall effect switch.In such embodiments, determining the relative angle between the framemember and the rotating member may be based on a signal generated by theHall Effect switch. In at least one embodiment, the wearable deviceincludes a photon-detector (e.g. a camera) and a photon-emitter (e.g. alaser or a collimated light emitting diode). When operating the wearabledevice in the audible mode, the actions may further include determininga field-of-view (FOV) of the photon-detector. The photon-emitter may beemployed to project a visual indicator of a boundary and/or a center ofthe FOV of the photon-detector.

Many variations can be made to the illustrated embodiments of thepresent invention without departing from the scope of the presentinvention. Such modifications are within the scope of the presentinvention. Embodiments presented herein have been described in relationto particular embodiments which are intended in all respects to beillustrative rather than restrictive. Alternative embodiments andmodifications would be readily apparent to one of ordinary skill in theart, but would not depart from the scope of the present invention.

From the foregoing it will be seen that this invention is one welladapted to attain all ends and objects hereinabove set forth togetherwith the other advantages which are obvious and which are inherent tothe structure. It will be understood that certain features andsubcombinations are of utility and may be employed without reference toother features and subcombinations. This is contemplated by and iswithin the scope of the invention.

In the preceding detailed description, reference is made to theaccompanying drawings which form a part hereof wherein like numeralsdesignate like parts throughout, and in which is shown, by way ofillustration, embodiments that may be practiced. It is to be understoodthat other embodiments may be utilized and structural or logical changesmay be made without departing from the scope of the present disclosure.Therefore, the preceding detailed description is not to be taken in thelimiting sense, and the scope of embodiments is defined by the appendedclaims and their equivalents.

Various aspects of the illustrative embodiments have been describedusing terms commonly employed by those skilled in the art to convey thesubstance of their work to others skilled in the art. However, it willbe apparent to those skilled in the art that alternate embodiments maybe practiced with only some of the described aspects. For purposes ofexplanation, specific numbers, materials, and configurations are setforth in order to provide a thorough understanding of the illustrativeembodiments. However, it will be apparent to one skilled in the art thatalternate embodiments may be practiced without the specific details. Inother instances, well-known features have been omitted or simplified inorder not to obscure the illustrative embodiments.

Various operations have been described as multiple discrete operations,in turn, in a manner that is most helpful in understanding theillustrative embodiments; however, the order of description should notbe construed as to imply that these operations are necessarily orderdependent. In particular, these operations need not be performed in theorder of presentation. Further, descriptions of operations as separateoperations should not be construed as requiring that the operations benecessarily performed independently and/or by separate entities.Descriptions of entities and/or modules as separate modules shouldlikewise not be construed as requiring that the modules be separateand/or perform separate operations. In various embodiments, illustratedand/or described operations, entities, data, and/or modules may bemerged, broken into further sub-parts, and/or omitted.

The phrase “in one embodiment” or “in an embodiment” is used repeatedly.The phrase generally does not refer to the same embodiment; however, itmay. The terms “comprising,” “having,” and “including” are synonymous,unless the context dictates otherwise. The phrase “A/B” means “A or B.”The phrase “A and/or B” means “(A), (B), or (A and B).” The phrase “atleast one of A, B, and C” means “(A), (B), (C), (A and B), (A and C), (Band C), or (A, B, and C).”

What is claimed is:
 1. A method for operating a head-mounted display(HMD) device that includes a display and a frame configured to be wornon a head of a user, comprising: in response to detecting a transitionin an orientation of the display relative to the frame, transitioning amode of operation of the HMD device from a first mode to a second mode.2. The method of claim 1, wherein the HMD device further includes a boomarm that rotatably couples the display to the frame and detecting thetransition in the orientation of the display comprises: detecting arelative rotation between the boom arm and the frame.
 3. The method ofclaim 1, wherein the HMD device further includes one or more sensors andthe method further comprises: receiving one or more signals generated bythe one or more sensors; based on the received one or more signals,detecting a relative motion between the display and the frame; and inresponse to detecting the relative motion between the display and theframe, detecting the transition in the orientation of the display. 4.The method of claim 3, wherein the one or more sensors areposition-detecting sensors and include at least one of a Hall Effectsensor, a Hall Effect switch, an optical sensor, a mechanical switch, acapacitive sensor, a conductive switch, or a magnetic switch.
 5. Themethod of claim 1, wherein the first mode is an audible mode ofoperation of the HMD device and the second mode is a visual mode ofoperation of the HMD device.
 6. The method of claim 1, wherein the firstmode is a visual mode of operation of the HMD device and the second modeis an audible mode of operation of the HMD device.
 7. The method ofclaim 1, wherein the transition in the orientation of the displayrelative to the frame causes transitioning a position of the displaybetween a first position that is within a line-of-sight (LOS) of theuser and a second position that is excluded from the LOS of the user. 8.A head-mounted display (HMD device, comprising: a display; and a frameconfigured to be worn on a head of a user; at least one processordevice; and at least one computer-readable storage media storingcomputer-useable instructions that, when executed by the at least oneprocessor device, causes that at least one processor device to performaction for operating the HMD device, where in the actions comprise: inresponse to detecting a transition in an orientation of the displayrelative to the frame, transitioning a mode of operation of the HMDdevice from a first mode to a second mode.
 9. The HMD device of claim 8,further comprising: a boom arm that rotatably couples the display to theframe, and wherein an detecting the transition in the orientation of thedisplay includes detecting a relative rotation between the boom arm andthe frame.
 10. The HMD device of claim 8, further comprising one or moresensor devices and the actions further comprise: receiving, at the oneor more processor devices, one or more signals generated by the one ormore sensor devices; based on the received one or more signals,detecting a relative motion between the display and the frame; and inresponse to detecting the relative motion between the display and theframe, detecting the transition in the orientation of the display. 11.The HMD device of claim 10, wherein the one or more sensor devices areposition-detecting sensor devices and include at least one of a HallEffect sensor, a Hall Effect switch, an optical sensor, a mechanicalswitch, a capacitive sensor, a conductive switch, or a magnetic switch.12. The HMD device of claim 8, wherein the first mode is an audible modeof operation of the HMD device and the second mode is a visual mode ofoperation of the HMD device.
 13. The HMD device of claim 8, wherein thefirst mode is a visual mode of operation of the HMD device and thesecond mode is an audible mode of operation of the HMD device.
 14. TheHMD device of claim 8, wherein the transition in the orientation of thedisplay relative to the frame causes transitioning a position of thedisplay between a first position that is within a line-of-sight (LOS) ofthe user and a second position that is excluded from the LOS of theuser.
 15. A non-transitory computer-readable storage medium havinginstructions stored thereon for operating a head-mounted display (HMD)device that includes a display and a frame configured to be worn on ahead of a user, which, when executed by a processor of the HMD devicecause the HMD device to perform actions comprising: in response todetermining a change in a position of the display relative to a headsetof the wearable device, updating a mode of operation of the wearabledevice from a visual mode to an audio mode.
 16. The computer-readablestorage medium of claim 15, wherein the HMD device further includes aboom arm that rotatably couples the display to the frame and detectingthe transition in the orientation of the display comprises: detecting arelative rotation between the boom arm and the frame.
 17. Thecomputer-readable storage medium of claim 15, wherein the HMD devicefurther includes one or more sensors and the actions further comprise:receiving one or more signals generated by the one or more sensors;based on the received one or more signals, detecting a relative motionbetween the display and the frame; and in response to detecting therelative motion between the display and the frame, detecting thetransition in the orientation of the display.
 18. The computer-readablestorage medium of claim 17, wherein the one or more sensors areposition-detecting sensors and include at least one of a Hall Effectsensor, a Hall Effect switch, an optical sensor, a mechanical switch, acapacitive sensor, a conductive switch, or a magnetic switch.
 19. Thecomputer-readable storage medium of claim 15, wherein one of the firstmode or the second mode is an audible mode of operation of the HMDdevice and another of the first mode or second mode is a visual mode ofoperation of the HMD device.
 20. The computer-readable storage medium ofclaim 15, wherein the transition in the orientation of the displayrelative to the frame causes transitioning a position of the displaybetween a first position that is within a line-of-sight (LOS) of theuser and a second position that is excluded from the LOS of the user.